Keypad projection

ABSTRACT

A method for security and/or automation systems is described. In one embodiment, the method may include detecting a proximity of a user at a home automation device. The method may further include projecting an external display of home automation system information from the home automation device onto a surface. In some embodiments, the external display may be projected based, at least in part, on the detected proximity of the user at the home automation device.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 14/553,075, titled: “Keypad Projection”, filed on Nov. 25,2014. The disclosure of which is incorporated by reference herein in itsentirety.

BACKGROUND

The present disclosure, for example, relates to security and/orautomation systems, and more particularly to a system for pairingprojection technologies with home automation system control panels anddoor locking mechanisms in order to project messages and interactivekeypads onto surfaces.

Security and automation systems are widely deployed to provide varioustypes of communication and functional features such as monitoring,communication, notification, and/or others. These systems may be capableof supporting communication with a user through a communicationconnection or a system management action.

Existing laser projection technologies often require the user to push abutton to turn the system on and off, such that users may only receiveinformation from or interact with the system directly. Additionally,existing home automation devices or panels often include large rubber orplastic keypads that may detract from the visual appeal of the panel andmay prevent the panel from blending into the home's décor. Furthermore,users are typically required to interact with the panel directly at thekeypad in order to access any available home automation system messagesor status updates. Similarly, keyless door lock systems often includelarge, unsightly keypads that may attract the attention of burglars.

SUMMARY

One aspect of the disclosure relates to systems, methods, and relateddevices for providing the interactive capabilities of home automationdevices or panels and keyless locks without the need for keypads. Byproviding a projected keypad for home automation devices or panels anddoor locks, the aesthetic appeal of the panel, and the discreetness of abasic keyed lock, may be maintained while providing additionalfunctionalities to the user. For example, in addition to projecting akeypad, the home automation device may project home automation systemdata, updates, messages, and reminders to the user on a wall, floor,door or ceiling, such that the user may quickly receive relevant homeinformation without the need to scroll through messages piecemeal on thehome automation system panel screen.

Laser-projected keypad technology typically requires that users activatethe projection by turning the device on and off locally. Thisrequirement may limit the accessibility of the projection for userspassing by the device but not interacting directly with the device.Thus, one aspect of the disclosure relates to a proximity detectorintegrated into, or in communication with, the home automation device ordoor lock to allow for activation of the projection based on detecteduser approach or proximity, for example by using motion sensingtechnology, without the need for direct user interaction with the deviceor lock system. In this way, a user walking past the home automationdevice or hurriedly leaving his home may receive home security, climate,and other relevant home automation system information quickly andefficiently without the need to stop at the device.

Accordingly, in one embodiment, a method for security and/or automationsystems is provided. In one embodiment, the method may comprisedetecting a proximity of a user at a home automation device, andprojecting an external display of home automation system informationfrom the home automation device onto a surface. The external display maybe projected based, at least in part, on the detected proximity of theuser to the home automation device.

In one aspect of the disclosure, a secondary home automation devicehaving the projection mechanism may be positioned next to an entryway,while the primary home automation device may be more convenientlylocated at a central position in the home, for example in the kitchen orliving room. In this way, users may easily access pertinent homeautomation system information from rooms that receive the most use,while still maintaining the ease of arming and disarming a securitysystem or controlling home automation devices, for example, or receivingimportant system messages, near the primary point of entry and exit ofthe home. The secondary home automation device may be streamlined indesign because no physical keypad or panel display may be required, suchthat the device may be minimally intrusive and such that home aestheticsmay be achieved.

A further aspect of the disclosure relates to a keyless door lockingmechanism having a projected keypad. The locking mechanism may resemblean ordinary lock, so as to avoid drawing unnecessary attention to thesystem. When a user approaches the lock, a keypad may be projected ontothe door above, next to, or below the lock, such that the user may inputhis entry code at the keypad projection and lock or unlock the door. Forsafety purposes, in some embodiments the keypad may only be projectedwhen an approaching user is in possession of an approved device that maybe paired via Bluetooth, RFID, Wi-Fi, or any other acceptable means tothe locking device. If an appropriately paired device is not detected,the lock system may not project the keypad, and unapproved users may beunable to unlock the door. In some embodiments, the keypad may only beprojected when an authorized fingerprint or other biometricidentification means is received at the locking device. In this way,security may be increased over standard keyed and keyless lock systems,which make available their locking mechanisms to all approaching usersindiscriminately.

The foregoing has outlined rather broadly the features and technicaladvantages of examples according to this disclosure so that thefollowing detailed description may be better understood. Additionalfeatures and advantages will be described below. The conception andspecific examples disclosed may be readily utilized as a basis formodifying or designing other structures for carrying out the samepurposes of the present disclosure. Such equivalent constructions do notdepart from the scope of the appended claims. Characteristics of theconcepts disclosed herein—including their organization and method ofoperation—together with associated advantages will be better understoodfrom the following description when considered in connection with theaccompanying figures. Each of the figures is provided for the purpose ofillustration and description only, and not as a definition of the limitsof the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

A further understanding of the nature and advantages of the presentdisclosure may be realized by reference to the following drawings. Inthe appended figures, similar components or features may have the samereference label. Further, various components of the same type may bedistinguished by following a first reference label with a dash and asecond label that may distinguish among the similar components. However,features discussed for various components—including those having a dashand a second reference label—apply to other similar components. If onlythe first reference label is used in the specification, the descriptionis applicable to any one of the similar components having the same firstreference label irrespective of the second reference label.

FIG. 1 is a block diagram of an example of a security and/or automationsystem in accordance with various embodiments;

FIGS. 2A-2B show block diagrams of a device relating to a securityand/or an automation system, in accordance with various aspects of thisdisclosure;

FIG. 3 shows a block diagram of a device relating to a security and/oran automation system, in accordance with various aspects of thisdisclosure;

FIG. 4 is a block diagram of an example of a keypad projected from ahome automation device, in accordance with various aspects of thisdisclosure;

FIG. 5 is a block diagram of an example of a home automation devicepanel, in accordance with various aspects of this disclosure;

FIG. 6 is a flow chart illustrating an example of a method relating to asecurity and/or an automation system, in accordance with various aspectsof this disclosure;

FIG. 7 is a flow chart illustrating an example of a method relating to asecurity and/or an automation system, in accordance with various aspectsof this disclosure; and

FIG. 8 is a flow chart illustrating an example of a method relating to asecurity and/or an automation system, in accordance with various aspectsof this disclosure.

DETAILED DESCRIPTION

The systems and methods described herein relate to projecting homeautomation system data. More specifically, the systems and methodsdescribed herein provide a means to project messages and interactivekeypads onto surfaces such as walls, floors, ceilings, and doors, wherethe projections may be activated, at least in part, based on detecteduser approach or proximity to the projecting device.

The following description provides examples and is not limiting of thescope, applicability, and/or examples set forth in the claims. Changesmay be made in the function and/or arrangement of elements discussedwithout departing from the scope of the disclosure. Various examples mayomit, substitute, and/or add various procedures and/or components asappropriate. For instance, the methods described may be performed in anorder different from that described, and/or various steps may be added,omitted, and/or combined. Also, features described with respect to someexamples may be combined in other examples.

FIG. 1 is an example of a home automation system 100 in accordance withvarious aspects of the disclosure. In some embodiments, the homeautomation system 100 may include one or more sensor units 110, localcomputing device 115, 120, network 125, server 130, control panel 135,and remote computing device 140. The network 125 may provide userauthentication, encryption, access authorization, tracking, InternetProtocol (IP) connectivity, and other access, calculation, modification,and/or functions. The control panel 135 may interface with the network125 through wired and/or wireless communication links 145 and mayperform communication configuration, adjustment, and/or scheduling forcommunication with local computing device 115, 120 or remote computingdevice 140, or may operate under the control of a controller. Controlpanel 135 may communicate with a back end server 130—directly and/orindirectly—using one or more communication links 145.

The control panel 135 may wirelessly communicate via communication links145 with the local computing device 115, 120 via one or more antennas(not shown). The control panel 135 may provide communication coveragefor a geographic coverage area. In some examples, control panel 135 maybe referred to as a control device, a base transceiver station, a radiobase station, an access point, a radio transceiver, a home automationcontrol panel, a smart home panel, or some other suitable terminology.The geographic coverage area for control panel 135 may be divided intosectors making up only a portion of the coverage area. The homeautomation system 100 may include one or more control panels 135 ofdifferent types. The control panel 135 may be related to one or morediscrete structures (e.g., a home, a business) and each of the one morediscrete structures may be related to one or more discrete areas.Control panel 135 may be a smart home system panel, for example aninteractive panel mounted on a wall in a user's home. In otherembodiments, control panel 135 may instead be a door locking mechanism.Control panel 135 may be in direct communication via wired or wirelesscommunication links 145 with the one or more sensor units 110, or mayreceive sensor data from the one or more sensor units 110 via localcomputing devices 115, 120 and network 125, or may receive data viaremote computing device 140, server 130, and network 125.

In any embodiment, control panel 135 may comprise a projectionmanagement module, described in more detail below with respect to FIG.2A. The control panel 135 may be operable to project messages orinteractive keypad displays onto a surface, and may further be operableto receive user input at the projected interactive keypad. Theinteractive keypad may comprise a series of numbers, letters, orfigures, and may be operable to receive any of a security code orcommands to operate home automation systems, such as turning on and offlights, changing thermostat settings, arming and disarming securitysystems, and the like. In some embodiments, the projected interactivekeypad display may resemble the screen of a thermostat control or alight switch, such that users may receive information from and interactwith the display much as they would a conventional thermostat or lightswitch.

The local computing devices 115, 120 may be dispersed throughout thehome automation system 100 and each device 115, 120 may be stationaryand/or mobile. Local computing devices 115, 120 and remote computingdevice 140 may be custom computing entities configured to interact withone or more sensor units 110 via network 125, and in some embodiments,via server 130. In other embodiments, local computing devices 115, 120and remote computing device 140 may be general purpose computingentities. A device 115, 120 or 140 may include a cellular phone, apersonal digital assistant (PDA), a wireless modem, a wirelesscommunication device, a handheld device, a tablet computer, a laptopcomputer, a cordless phone, a wireless local loop (WLL) station, adisplay device (e.g., TVs, computer monitors, etc.), a printer, asensor, and/or the like. A device 115, 120 may also include or bereferred to by those skilled in the art as a user device, a sensor, asmartphone, an iPod®, an iPad®, a Bluetooth device, a Wi-Fi device, amobile station, a subscriber station, a mobile unit, a subscriber unit,a wireless unit, a remote unit, a mobile device, a wireless device, awireless communications device, a remote device, an access terminal, amobile terminal, a wireless terminal, a remote terminal, a handset, auser agent, a mobile client, a client, and/or some other suitableterminology. A local computing device 115, 120 and/or control panel 135may include and/or be one or more sensors that sense: proximity, motion,temperatures, humidity, sound level, smoke, structural features (e.g.,glass breaking, window position, door position), time, geo-location dataof a user and/or a device, distance, biometrics, weight, speed, height,size, preferences, light, darkness, weather, time, system performance,and/or other inputs that relate to a security and/or an automationsystem. A local computing device 115, 120 may be able to communicatethrough one or more wired and/or wireless communication links 145 withvarious components such as control panels, base stations, and/or networkequipment (e.g., servers, wireless communication points, etc.) and/orthe like.

The communication links 145 shown in home automation system 100 mayinclude uplink (UL) transmissions from a local computing device 115, 120to a control panel 135, and/or downlink (DL) transmissions from acontrol panel 135 to a local computing device 115, 120. The downlinktransmissions may also be called forward link transmissions while theuplink transmissions may also be called reverse link transmissions. Eachcommunication link 145 may include one or more carriers, where eachcarrier may be a signal made up of multiple sub-carriers (e.g., waveformsignals of different frequencies) modulated according to the variousradio technologies. Each modulated signal may be sent on a differentsub-carrier and may carry control information (e.g., reference signals,control channels, etc.), overhead information, user data, etc. Thecommunication links 145 may transmit bidirectional communications and/orunidirectional communications. Communication links 145 may include oneor more connections, including but not limited to, 345 MHz, Wi-Fi,Bluetooth, cellular, Z Wave, 802.11, peer-to-peer, LAN, WLAN, Ethernet,fire wire, fiber optic, and/or other connection types related tosecurity and/or automation systems.

In some embodiments of home automation system 100, control panel 135and/or local computing devices 115, 120 may include one or more antennasfor employing antenna diversity schemes to improve communication qualityand reliability between control panel 135 and local computing devices115, 120. Additionally or alternatively, control panel 135 and/ordevices 115, 120 may employ multiple-input, multiple-output (MIMO)techniques that may take advantage of multi-path, mesh-type environmentsto transmit multiple spatial layers carrying the same or different codeddata.

While the local computing devices 115, 120 may communicate with eachother through the control panel 135 using communication links 145, eachdevice 115, 120 may also communicate directly with one or more otherdevices via one or more direct communication links 145. Two or morelocal computing devices 115, 120 may communicate via a directcommunication link 145 when both devices 115, 120 are in the geographiccoverage area or when one or neither devices 115, 120 is within thegeographic coverage area. Examples of direct communication links 145 mayinclude Wi-Fi Direct, Bluetooth, wired, and/or, and other P2P groupconnections. The devices 115, 120 in these examples may communicateaccording to the WLAN radio and baseband protocol including physical andMAC layers from IEEE 802.11, and its various versions including, but notlimited to, 802.11b, 802.11g, 802.11a, 802.11n, 802.11ac, 802.11ad,802.11ah, etc. In other implementations, other peer-to-peer connectionsand/or ad hoc networks may be implemented within home automation system100.

In some embodiments, one or more sensor units 110 may communicate viawired or wireless communication links 145 with one or more of the localcomputing device 115, 120 or network 125. The network 125 maycommunicate via wired or wireless communication links 145 with thecontrol panel 135 and the remote computing device 140 via server 130. Inalternate embodiments, the network 125 may be integrated with any one ofthe local computing device 115, 120, server 130, or remote computingdevice 140, such that separate components are not required.Additionally, in alternate embodiments, one or more sensor units 110 maybe integrated with control panel 135, and/or control panel 135 may beintegrated with local computing device 115, 120, such that separatecomponents are not required.

The local computing devices 115, 120 and/or control panel 135 mayinclude memory, a processor, an output, a data input and a communicationmodule. The processor may be a general purpose processor, a FieldProgrammable Gate Array (FPGA), an Application Specific IntegratedCircuit (ASIC), a Digital Signal Processor (DSP), and/or the like. Theprocessor may be configured to retrieve data from and/or write data tothe memory. The memory may be, for example, a random access memory(RAM), a memory buffer, a hard drive, a database, an erasableprogrammable read only memory (EPROM), an electrically erasableprogrammable read only memory (EEPROM), a read only memory (ROM), aflash memory, a hard disk, a floppy disk, cloud storage, and/or soforth. In some embodiments, the local computing devices 115, 120 and/orcontrol panel 135 may include one or more hardware-based modules (e.g.,DSP, FPGA, ASIC) and/or software-based modules (e.g., a module ofcomputer code stored at the memory and executed at the processor, a setof processor-readable instructions that may be stored at the memory andexecuted at the processor) associated with executing an application,such as, for example, receiving and displaying data from one or moresensor units 110.

The processor of the local computing devices 115, 120 and/or controlpanel 135 may be operable to control operation of the output of thelocal computing devices 115, 120 and/or control panel 135. The outputmay be a television, a liquid crystal display (LCD) monitor, a cathoderay tube (CRT) monitor, speaker, tactile output device, and/or the like.In some embodiments, the output may be an interactive or non-interactivelaser projection. In some embodiments, the output may be an integralcomponent of the local computing devices 115, 120. Similarly stated, theoutput may be directly coupled to the processor. For example, the outputmay be the integral display of a tablet and/or smart phone. In someembodiments, an output module may include, for example, a HighDefinition Multimedia Interface™ (HDMI) connector, a Video GraphicsArray (VGA) connector, a Universal Serial Bus™ (USB) connector, a tip,ring, sleeve (TRS) connector, and/or any other suitable connectoroperable to couple the local computing devices 115, 120 and/or controlpanel 135 to the output.

The remote computing device 140 may be a computing entity operable toenable a remote user to monitor the output of the one or more sensorunits 110. The remote computing device 140 may be functionally and/orstructurally similar to the local computing devices 115, 120 and may beoperable to receive data streams from and/or send signals to at leastone of the sensor units 110 via the network 125. The network 125 may bethe Internet, an intranet, a personal area network, a local area network(LAN), a wide area network (WAN), a virtual network, atelecommunications network implemented as a wired network and/orwireless network, etc. The remote computing device 140 may receiveand/or send signals over the network 125 via communication links 145 andserver 130.

In some embodiments, the one or more sensor units 110 may be sensorsconfigured to conduct periodic or ongoing automatic measurements relatedto user approach or proximity to the one or more sensor units 110 and/orcontrol panel 135. Each sensor unit 110 may be capable of sensingmultiple proximity parameters, or alternatively, separate sensor units110 may monitor separate proximity parameters. For example, one sensorunit 110 may measure user approach using motion sensors, while anothersensor unit 110 (or, in some embodiments, the same sensor unit 110) maydetect user proximity via heat or heartbeat detection. In someembodiments, one or more sensor units 110 may additionally monitoralternate proximity parameters, such as RFID or Bluetooth signals. Inalternate embodiments, a user may input proximity data directly at thelocal computing device 115, 120 or at remote computing device 140. Forexample, a user may enter proximity data into a dedicated application onhis smartphone indicating that he is returning home, and the controlpanel 135 may register that proximity accordingly. Alternatively or inaddition, a GPS feature integrated with the dedicated application on theuser's smartphone may communicate the user's proximity to his homeautomation system at the one or more sensor units 110 and/or controlpanel 135.

In some embodiments, the one or more sensor units 110 may be separatefrom the control panel 135, and may be positioned at various locationsthroughout the home or property. In other embodiments, the one or moresensor units 110 may be integrated or collocated with home automationsystem components or home appliances or fixtures. For example, a sensorunit 110 may be integrated with a doorbell system, or may be integratedwith a front porch light. In other embodiments, a sensor unit 110 may beintegrated with a wall outlet or switch. In still other embodiments, theone or more sensor units 110 may be integrated or collocated with thecontrol panel 135 itself, as discussed in more detail below with respectto FIG. 5.

Data gathered by the one or more sensor units 110 may be communicated tolocal computing device 115, 120, which may be, in some embodiments, athermostat or other wall-mounted input/output smart home display. Inother embodiments, local computing device 115, 120 may be a personalcomputer or smartphone. Where local computing device 115, 120 is a smartphone, the smart phone may have a dedicated application directed tocollecting user proximity data. The local computing device 115, 120 mayprocess the data received from the one or more sensor units 110 toobtain instructions to project a message or interactive keypad at thecontrol panel 135. In alternate embodiments, remote computing device 140may process the data received from the one or more sensor units 110, vianetwork 125 and server 130, to obtain instructions to project a messageor interactive keypad at the control panel 135. Data transmission mayoccur via, for example, frequencies appropriate for a personal areanetwork (such as Bluetooth or IR communications) or local or wide areanetwork frequencies such as radio frequencies specified by the IEEE802.15.4 standard.

In some embodiments, local computing device 115, 120 may communicatewith remote computing device 140 or control panel 135 via network 125and server 130. Examples of networks 125 include cloud networks, localarea networks (LAN), wide area networks (WAN), virtual private networks(VPN), wireless networks (using 802.11, for example), and/or cellularnetworks (using 3G and/or LTE, for example), etc. In someconfigurations, the network 125 may include the Internet. In someembodiments, a user may access the functions of local computing device115, 120 from remote computing device 140. For example, in someembodiments, remote computing device 140 may include a mobileapplication that interfaces with one or more functions of localcomputing device 115, 120.

The server 130 may be configured to communicate with the sensor units110, the local computing devices 115, 120, the remote computing device140 and control panel 135. The server 130 may perform additionalprocessing on signals received from the one or more sensor units 110 orlocal computing devices 115, 120, or may simply forward the receivedinformation to the remote computing device 140 and control panel 135.

Server 130 may be a computing device operable to receive data streams(e.g., from one or more sensor units 110 and/or local computing device115, 120 or remote computing device 140), store and/or process data,and/or transmit data and/or data summaries (e.g., to remote computingdevice 140). For example, server 130 may receive a stream of occupancyor user approach data based on motion detection from a sensor unit 110,a stream of occupancy or user approach data based on vibrationmonitoring from the same or a different sensor unit 110, and a stream ofoccupancy or user approach data derived from RFID signals from eitherthe same or yet another sensor unit 110. In some embodiments, server 130may “pull” the data streams, e.g., by querying the sensor units 110, thelocal computing devices 115, 120, and/or the control panel 135. In someembodiments, the data streams may be “pushed” from the sensor units 110and/or the local computing devices 115, 120 to the server 130. Forexample, the sensor units 110 and/or the local computing device 115, 120may be configured to transmit data as it is generated by or entered intothat device. In some instances, the sensor units 110 and/or the localcomputing devices 115, 120 may periodically transmit data (e.g., as ablock of data or as one or more data points).

The server 130 may include a database (e.g., in memory) containing userapproach, occupancy or proximity data received from the sensor units 110and/or the local computing devices 115, 120. Additionally, as describedin further detail herein, software (e.g., stored in memory) may beexecuted on a processor of the server 130. Such software (executed onthe processor) may be operable to cause the server 130 to monitor,process, summarize, present, and/or send a signal associated with userapproach, occupancy or proximity data.

FIG. 2A shows a block diagram 200 of an apparatus 205 for use insecurity and/or automation systems, in accordance with various aspectsof this disclosure. The apparatus 205 may be an example of one or moreaspects of a control panel 135, or in other embodiments may be anexample of one or more aspects of the one or more sensor units 110, bothof which are described with reference to FIG. 1. The apparatus 205 mayinclude any of a receiver module 210, a projection management module215, and/or a transmitter module 220. The apparatus 205 may also be orinclude a processor. Each of these modules may be in communication witheach other—directly and/or indirectly.

As previously discussed, in some embodiments, where apparatus 205 is acontrol panel, apparatus 205 may be a control panel in the form of, forexample, an interactive home automation system display. In otherembodiments, apparatus 205 may be a door locking mechanism, for examplepositioned on an outer surface of a door. In still other embodiments,apparatus 205 may be at least one sensor unit located adjacent to orremotely from the control panel or door locking mechanism at which theprojection may be generated.

The components of the apparatus 205 may, individually or collectively,be implemented using one or more application-specific integratedcircuits (ASICs) adapted to perform some or all of the applicablefunctions in hardware. Alternatively, the functions may be performed byone or more other processing units (or cores), on one or more integratedcircuits. In other examples, other types of integrated circuits may beused (e.g., Structured/Platform ASICs, Field Programmable Gate Arrays(FPGAs), and other Semi-Custom ICs), which may be programmed in anymanner known in the art. The functions of each module may also beimplemented—in whole or in part—with instructions embodied in memoryformatted to be executed by one or more general and/orapplication-specific processors.

The receiver module 210 may receive information such as packets, userdata, and/or control information associated with various informationchannels (e.g., control channels, data channels, etc.). The receivermodule 210 may be configured to receive user occupancy, approach, and/orproximity data. User proximity, approach, and/or occupancy informationmay be passed on to the projection management module 215, transmittermodule 220, and to other components of the apparatus 205.

The components of the apparatus 205 may, individually or collectively,be implemented using one or more application-specific integratedcircuits (ASICs) adapted to perform some or all of the applicablefunctions in hardware. Alternatively, the functions may be performed byone or more other processing units (or cores), on one or more integratedcircuits. In other examples, other types of integrated circuits may beused (e.g., Structured/Platform ASICs, Field Programmable Gate Arrays(FPGAs), and other Semi-Custom ICs), which may be programmed in anymanner known in the art. The functions of each module may also beimplemented—in whole or in part—with instructions embodied in memoryformatted to be executed by one or more general and/orapplication-specific processors.

Apparatus 205-a, which may be an example of apparatus 205 illustrated inFIG. 2A, is further detailed in FIG. 2B. Apparatus 205-a may compriseany of receiver module 210-a, projection management module 215-a, and/ortransmitter module 220-a, each of which may be examples of receivermodule 210, projection management module 215, and transmitter module 220as illustrated in FIG. 2A. Apparatus 205-a may comprise, as a componentof receiver module 210-a, one or more sensor modules 225 configured todetect user proximity, approach, and/or occupancy data through a varietyof means. For example, the one or more sensor modules 225 may detectuser approach to the apparatus 205-a via any of a motion detector,vibration detector, heat or heartbeat detector, light detector, RFID orBluetooth sensor, or a combination thereof. The user proximity orapproach data sensed at the one or more sensor modules 225 may then becommunicated to the projection management module 215-a. Projectionmanagement module 215-a may comprise any of proximity detector module230, projection delay module 235, and/or input processor module 240.

The components of the apparatus 205-a may, individually or collectively,be implemented using one or more application-specific integratedcircuits (ASICs) adapted to perform some or all of the applicablefunctions in hardware. Alternatively, the functions may be performed byone or more other processing units (or cores), on one or more integratedcircuits. In other examples, other types of integrated circuits may beused (e.g., Structured/Platform ASICs, Field Programmable Gate Arrays(FPGAs), and other Semi-Custom ICs), which may be programmed in anymanner known in the art. The functions of each module may also beimplemented—in whole or in part—with instructions embodied in memoryformatted to be executed by one or more general and/orapplication-specific processors.

Based on the user proximity, approach, or occupancy data received at oneor more sensor modules 225, proximity detector module 230 may calculatethe proximity of the approaching user to the apparatus 205-a. Theproximity calculation may then be communicated to projection delaymodule 235, which may calculate any delay required before projection ofa message or interactive keypad should be initiated. For example, whereapparatus 205-a is a control panel, proximity detector module 230 maydetect that a user is approaching the control panel, but is still 10feet away from the panel. Projection delay module 235 may thereforecalculate, for example, a required two-second delay before projectingthe message or interactive keypad, such that the message or interactivekeypad may be displayed only when the user is close enough to readand/or interact with the message or keypad. The projection delay module235 may continuously update the requisite time delay for projectionbased on continuously provided user approach or proximity data collectedby one or more sensor module 225. In this way, if the user stops orslows down in his approach to the control panel, or decides not toapproach the panel at all, a message or interactive keypad may not beunnecessarily projected. In other embodiments, proximity detector module230 and projection delay module 235 may project a message or interactivekeypad once a user has crossed a predetermined proximity threshold, suchthat the message is viewable by the user regardless of whether he isactually approaching the control panel, or is instead merely passing bythe control panel. In another example, proximity detector module 230 maycalculate that the user is already sufficiently close to the controlpanel, such that projection delay module 235 may provide for immediateprojection of the message or interactive keypad, without the need for adelay. Projection management module 215-a may accordingly project themessage or interactive keypad onto a surface adjacent to the controlpanel, such as a wall, ceiling, floor, door, or other suitable surface.

The projected message may include information relating to the homeautomation system, or may alternatively comprise any informationrelevant to the user. In some embodiments, the user may preselectpreferences for the content of message displays by inputting preferencesat, for example, the home automation system control panel or localcomputing device. For example, the user may elect to have relevant homesecurity data displayed as he is approaching or passing by the system,such as messages relating to whether the system is armed or disarmed,whether any doors or windows are open, whether any alarms have beentriggered, etc. The user may alternatively or in addition programreminders to display when he passes by the system, for examplecalendar-related reminders or reminders to bring his keys or phone, orto arm the system, upon leaving. In other embodiments, the home securitysystem may automatically determine messages to project based on thestate of the system, for example messages relating to low batteries,triggered alarms, current thermostat settings, approach of third partiesto the front door or ringing the doorbell, and the like.

Where apparatus 205-a is a control panel or door locking mechanism, andfurther where the projected external display is an interactive keypad,input processor module 240 may be operable to receive user input at theinteractive keypad. The interactive keypad may be projected by any meansknown in the art, for example by a laser or beamer, and may comprise asensor or camera at the input processor module 240 to detect user inputin the form of finger movements or gestures. In some embodiments,apparatus 205-a may be further operable to receive user input in theform of audible input. In some embodiments, two projections may begenerated: a first, visible virtual keypad, and a second, invisibleinfrared beam above the virtual keypad, such that when a user moves hisfingers or makes gestures in front of the invisible infrared beam, theuser's finger or body breaks the beam and reflects light back to theprojector. The reflected beam may pass through an infrared filter to thecamera, and the camera may photograph the angle of incoming infraredlight. The input processor module 240 may then determine where theinfrared beam was broken, and may correlate that break to an action orcharacter. For example, a user may input a security system arming codeat the keypad projected at the control panel. In other embodiments,where apparatus 205-a is a door locking mechanism, a user may input acode to unlock or lock the door to which the door locking mechanism isaffixed or with which the door locking mechanism is integrated. In stillother embodiments, a user may input a command at the interactive keypadto turn on or off lights, or change the settings on a thermostat, or anyother control functions for home automation systems.

Based, at least in part, on the user input received at input processormodule 240, action instructions may be communicated from input processormodule 240 to transmitter module 220-a. For example, a security systemarming/disarming code inputted at the control panel and processed byinput processor module 240 may be communicated to transmitter module220-a, which may transmit action instructions to disarm a security alarmsystem at the home automation system. In some embodiments, apparatus205-a may comprise a component of the home automation system, such thatthe action instructions to disarm the security alarm system may beprocessed locally. In other embodiments, apparatus 205-a may be asecondary control panel, and the action instructions may be communicatedto the primary control panel to execute the action instructions anddisarm the security alarm system. In some examples the transmittermodule 220-a may be collocated with the receiver module 210-a in atransceiver module.

In other embodiments, apparatus 205-a may be an example of one or moresensor units 110, as illustrated in FIG. 1. The one or more sensor unitsmay be located adjacent to or remotely from the control panel at whichmessages or interactive keypads are projected. Where apparatus 205-a isa sensor unit, sensor module 225 may detect user proximity, approach, oroccupancy at the sensor unit. This proximity data may be communicated toproximity detector module 230, which may calculate the proximity of theuser to the control panel based on the known distance of the sensor unitfrom the control panel. In order to calculate this proximitymeasurement, the home automation system may “know” or receive dataindicating the precise location of each of the one or more sensor unitsand one or more control panels positioned throughout the home orproperty. Based on this calculated distance, projection delay module 235may calculate a necessary time delay before activation of the projectedmessage or interactive keypad, to allow time for the user to travel fromthe sensor unit to the control panel. In embodiments in which apparatus205-a is a sensor unit, projection management module 215-a may notcomprise input processor module 240, as any user input may instead takeplace at the control panel from which the message or interactive keypadis projected. Where apparatus 205-a is a sensor unit, transmitter module220-a may transmit the calculated requisite time delay from projectiondelay module 235 to the control panel, such that the control panel mayinitiate the projection based, at least in part, on the calculated timedelay data.

In some embodiments, home automation system 100, as illustrated in FIG.1, may comprise one or more sensor units 110 and one or more controlpanels 135, where each of the sensor units and control panels areoperable to detect user approach, occupancy, and/or proximity, such thatthe system may track users' movement toward or throughout the home orproperty, and may project messages or interactive keypads from one ormore control panels positioned throughout the home. For example, one ormore sensor units positioned at a front door of a home may communicateuser approach data to a door locking mechanism positioned on the frontdoor, wherein the door locking mechanism may project an interactivekeypad for user entry based, at least in part, on the received userproximity or approach data. Moreover, user approach or proximity datadetected at one or both of a sensor unit at the front door and the doorlocking mechanism may be communicated to a control panel positioned inthe living room, such that a projection delay module in the controlpanel may calculate a time delay to allow the user time to enter thehome and walk to the living room before projecting messages relating tohome automation system information. If, for example, the user changesdirection inside the home before reaching the living room, sensorspositioned in, for example, a hallway, may send user proximity data to acontrol panel located in the user's bedroom, or whichever room the useris headed towards. A projection delay module of the control panel in thebedroom may again calculate a time delay to allow time for the user topass from the hallway into the bedroom, and may project messages for theuser accordingly. In this way, the home automation system may “follow”the user around the home and display pertinent information or neededkeypads for the user in appropriate locations. This may serve to bothconserve energy usage by displaying messages and keypads only in roomswhere the user is detected, and may further provide for the convenienceof projecting pertinent information to the user as he enters rooms,without the need for the user to interact directly with the controlpanel.

In some embodiments, messages or interactive keypads may be projected atthe one or more control panels based on user occupancy patterns detectedby the home automation system. For example, the home automation systemmay “learn,” based on the data gathered by the one or more sensor units,that a user always returns home at 5:30 pm on weekdays, and maycommunicate action instructions to a door locking mechanism on the frontdoor of the home to project a keypad at 5:30 pm every weekday. Inanother example, the home automation system may learn that a user isalways in the living room between 8:00 and 10:00 pm, and may communicateaction instructions to a control panel positioned in the living room toproject messages containing relevant home automation system informationduring that time window.

In some embodiments, sensor module 225 may be further operable toidentify and/or authenticate a user approaching the apparatus 205-athrough a number of means. For example, sensor module 225 may receivesignals via Bluetooth, RFID or Wi-Fi from a mobile smartphone, fob, orother device in the possession of the user, where the mobile device islinked to the apparatus 205-a, which may be a sensor or control panel.In other embodiments, the sensor module 225 may identify and/orauthenticate the approaching user based on facial recognition technologyand/or biosignature detecting technology. Where the signal from themobile device or the facial recognition data detected at the sensormodule 225 is authenticated as an approved user, the sensor module 225may communicate action instructions to projection management module215-a to display the message or interactive keypad. However, where thesignal from the mobile device detected at the sensor module 225, orwhere the identity provided by the biosignature detecting technology, isnot identified as an approved user, or in some embodiments, where nosignal is detected from a mobile device at the sensor module 225, thesensor module 225 may communicate instructions to projection managementmodule 215-a that no message or interactive keypad should be projected.In this way, unapproved users approaching, for example, a door lockingmechanism positioned on or integrated with a homeowner's front door maynot be provided with a projected keypad, such that the unapproved usermay have no means by which to unlock the door.

In other embodiments, the type of projected message or interactivekeypad may be tailored to the particular user identified. For example,approaching users identified as occupants of the home may be providedwith more information in messages or more detailed interactive keypadsthan, for example, approaching users identified as delivery persons.Preferences for content of projection displays based on approaching useridentities may be preselected by homeowners based on, for example, inputat the home automation system, or may be derived by the home automationsystem automatically based on detected patterns. For example, the homeautomation system may assume that persons approaching the front doorduring the hours of 9:00 am to 5:00 pm on weekdays are delivery personsand not the homeowners, based on detected homeowner occupancy datapatterns, and may accordingly display information and/or keypads at thefront door tailored to the delivery persons.

FIG. 3 shows a system 300 for use in home automation system method andinteractive keypad projection systems, in accordance with variousexamples. System 300 may include an apparatus 205-b, which may be anexample of the control panel 135 and/or one or more sensor units 110 ofFIG. 1. Apparatus 205-b may also be an example of one or more aspects ofapparatus 205 and/or 205-a of FIGS. 2A and 2B. Apparatus 205-b mayinclude projection management module 215-b, which may be an example ofprojection management module 215, 215-a described with reference toFIGS. 2A and 2B.

Apparatus 205-b may also include components for bi-directional voice anddata communications including components for transmitting communicationsand components for receiving communications. For example apparatus 205-bmay communicate bi-directionally with one or more of security/automationdevice 360 or remote server 130-a. This bi-directional communication maybe direct (e.g., apparatus 205-b communicating directly with remoteserver 130-a) or indirect. Remote server 130-a may be an example ofremote server 130 shown with respect to FIG. 1.

The projection management module 215-b may receive user approach,proximity, and/or occupancy data based, at least in part, on datareceived at one or more sensor units, and may utilize that data toprocess a projection of a message or interactive keypad, as describedabove with reference to FIGS. 2A-2B. For example, projection managementmodule 215-b may receive user proximity data from one or more sensorunits located separately from a control panel, and may process aprojection display time delay at projection management module 215-bbased on the known distance of the user-detecting sensor unit from thecontrol panel. Based on this calculated projection display time delay, amessage or interactive keypad may be projected at the control panel at atime coinciding with user approach or proximity to the control panel.Where the one or more sensor units are collocated with the controlpanel, a lesser projection display time delay may be needed, or noprojection delay may be required at all.

Apparatus 205-b may also include a processor module 305, and memory 310(including software (SW) 315), an input/output controller module 320, auser interface module 325, a transceiver module 330, and one or moreantennas 335, each of which may communicate—directly or indirectly—withone another (e.g., via one or more buses 355). The transceiver module330 may communicate bi-directionally—via the one or more antennas 335,wired links, and/or wireless links—with one or more networks or remotedevices as described above. For example, the transceiver module 330 maycommunicate bi-directionally with one or more of remote server 130-a orsecurity/automation device 360. The transceiver module 330 may include amodem to modulate the packets and provide the modulated packets to theone or more antennas 335 for transmission, and to demodulate packetsreceived from the one or more antennas 335. While an apparatuscomprising a sensor unit or control panel (e.g., 205-b) may include asingle antenna 335, the apparatus may also have multiple antennas 335capable of concurrently transmitting or receiving multiple wired and/orwireless transmissions. In some embodiments, one element of apparatus205-b (e.g., one or more antennas 335, transceiver module 330, etc.) mayprovide a direct connection to a remote server 130-a via a directnetwork link to the Internet via a POP (point of presence). In someembodiments, one element of apparatus 205-b (e.g., one or more antennas335, transceiver module 330, etc.) may provide a connection usingwireless techniques, including digital cellular telephone connection,Cellular Digital Packet Data (CDPD) connection, digital satellite dataconnection, and/or another connection.

The signals associated with system 300 may include wirelesscommunication signals such as radio frequency, electromagnetics, localarea network (LAN), wide area network (WAN), virtual private network(VPN), wireless network (using 802.11, for example), 345 MHz, Z Wave,cellular network (using 3G and/or LTE, for example), and/or othersignals. The one or more antennas 335 and/or transceiver module 330 mayinclude or be related to, but are not limited to, WWAN (GSM, CDMA, andWCDMA), WLAN (including Bluetooth and Wi-Fi), WMAN (WiMAX), antennas formobile communications, antennas for Wireless Personal Area Network(WPAN) applications (including RFID and UWB). In some embodiments eachantenna 335 may receive signals or information specific and/or exclusiveto itself. In other embodiments each antenna 335 may receive signals orinformation not specific or exclusive to itself.

In some embodiments, the user interface module 325 may include an audiodevice, such as an external speaker system, an external display devicesuch as a display screen, and/or an input device (e.g., remote controldevice interfaced with the user interface module 325 directly and/orthrough I/O controller module 320).

One or more buses 355 may allow data communication between one or moreelements of apparatus 205-b (e.g., processor module 305, memory 310, I/Ocontroller module 320, user interface module 325, etc.).

The memory 310 may include random access memory (RAM), read only memory(ROM), flash RAM, and/or other types. The memory 310 may storecomputer-readable, computer-executable software/firmware code 315including instructions that, when executed, cause the processor module305 to perform various functions described in this disclosure (e.g.,detect user approach and/or proximity at a sensor unit and/or controlpanel, calculate a projection delay based on detected user proximity anddistance between the user and the control panel, communicate actioninstructions based on detected user input at the projection, etc.).Alternatively, the software/firmware code 315 may not be directlyexecutable by the processor module 305 but may cause a computer (e.g.,when compiled and executed) to perform functions described herein.

In some embodiments the processor module 305 may include, among otherthings, an intelligent hardware device (e.g., a central processing unit(CPU), a microcontroller, and/or an ASIC, etc.). The memory 310 cancontain, among other things, the Basic Input-Output system (BIOS) whichmay control basic hardware and/or software operation such as theinteraction with peripheral components or devices. For example, theprojection management module 215-b to implement the present systems andmethods may be stored within the system memory 310. Applicationsresident with system 300 are generally stored on and accessed via anon-transitory computer readable medium, such as a hard disk drive orother storage medium. Additionally, applications can be in the form ofelectronic signals modulated in accordance with the application and datacommunication technology when accessed via a network interface (e.g.,transceiver module 330, one or more antennas 335, etc.).

The memory 310 may include random access memory (RAM) and read-onlymemory (ROM). The memory 310 may store computer-readable,computer-executable software/firmware code 315 containing instructionsthat are configured to, when executed, cause the processor module 305 toperform various functions described herein (e.g., detect user approachand/or proximity at a sensor unit and/or control panel, calculate aprojection delay based on detected user proximity and distance betweenthe user and the control panel, communicate action instructions based ondetected user input at the projection, etc.). Alternatively, thecomputer-readable, computer-executable software/firmware code 315 maynot be directly executable by the processor module 305 but may beconfigured to cause a computer (e.g., when compiled and executed) toperform functions described herein. The processor module 305 may includean intelligent hardware device, e.g., a central processing unit (CPU), amicrocontroller, an application-specific integrated circuit (ASIC), etc.

Many other devices and/or subsystems may be connected to, or may beincluded as, one or more elements of system 300 (e.g., entertainmentsystem, computing device, remote cameras, wireless key fob, wall mounteduser interface device, cell radio module, battery, alarm siren, doorlock, lighting system, thermostat, home appliance monitor, utilityequipment monitor, and so on). In some embodiments all of the elementsshown in FIG. 3 need not be present to practice the present systems andmethods. The devices and subsystems can be interconnected in differentways from that shown in FIG. 3. In some embodiments, an aspect of someoperation of a system, such as that shown in FIG. 3, may be readilyknown in the art and is not discussed in detail in this disclosure. Codeto implement the present disclosure can be stored in a non-transitorycomputer-readable medium such as one or more of system memory 310 orother memory. The operating system provided on I/O controller module 320may be iOS®, ANDROID®, MS-dOS®, MS-WINDOWS®, OS/2®, UNIX®, LINUX®, oranother known operating system.

The transceiver module 330 may include a modem configured to modulatethe packets and provide the modulated packets to the antennas 335 fortransmission and/or to demodulate packets received from the antennas335. While the apparatus 205-b may include a single antenna 335, theapparatus 205-b may have multiple antennas 335 capable of concurrentlytransmitting and/or receiving multiple wireless transmissions.

The components of the apparatus 205-b may, individually or collectively,be implemented using one or more application-specific integratedcircuits (ASICs) adapted to perform some or all of the applicablefunctions in hardware. Alternatively, the functions may be performed byone or more other processing units (or cores), on one or more integratedcircuits. In other examples, other types of integrated circuits may beused (e.g., Structured/Platform ASICs, Field Programmable Gate Arrays(FPGAs), and other Semi-Custom ICs), which may be programmed in anymanner known in the art. The functions of each module may also beimplemented—in whole or in part—with instructions embodied in memoryformatted to be executed by one or more general and/orapplication-specific processors.

FIG. 4 is a block diagram 400 showing an example of a control panel135-a for projecting external messages and/or interactive keypads onto asurface, as described above. In any embodiment, control panel 135-a maybe an example of the one or more control panels 135 illustrated withrespect to FIG. 1. In the illustrated embodiment, control panel 135-amay project an interactive keypad 405 onto a surface adjacent to thecontrol panel 135-a. For example, where control panel 135-a iswall-mounted, interactive keypad 405 may be projected onto the wall onwhich the control panel 135-a is mounted, a wall adjacent to or acrossfrom the wall on which the control panel 135-a is mounted, or a floor orceiling adjacent to the wall on which the control panel 135-a ismounted. In other embodiments, where control panel 135-a is handheld orportable, interactive keypad 405 may be projected onto any opaquesurface adjacent to the control panel 135-a.

In the embodiment shown in FIG. 4, the interactive keypad 405 is shownhaving a plurality of virtual number keys. In other embodiments, theinteractive keypad 405 may comprise any combination of letters, numbers,or symbols operable to control home automation systems, or mayalternatively comprise a displayed message showing, for example, homeautomation system information. Control panel 135-a may, in someembodiments, be operable to receive and process user input in the formof “typing” on the virtual keypad, or alternatively in the form ofgestures detected at the control panel 135-a, as discussed in moredetail below with respect to FIG. 5.

In some embodiments, control panel 135-a may comprise a solid box orobject of any size or shape, not having any buttons, displays, orcontrols for user input. In this way, the control panel 135-a may bedesigned to be minimally visually intrusive on the décor of the home. Inother embodiments, the control panel 135-a may comprise any number orcombination of buttons or displays operable to receive and process userinput.

In some embodiments, control panel 135-a may further comprise afingerprint scanner or other biometric identifying means, such that theinteractive keypad 405 may only be displayed to authorized users.

FIG. 5 is a block diagram 500 illustrating an example of a control panel135-b for projecting messages and/or interactive keypads. As previouslydiscussed, in some embodiments, control panel 135-b may comprise only abox or other object of any size or shape having only a projection meansand a user input detection means, and not comprising any buttons,displays, or controls for direct user input. In other embodiments, asillustrated in FIG. 5, control panel 135-b may comprise a receivermodule 505, projection management module 510, and transmitter module515, which may be examples of receiver module 210, 210-a, projectionmanagement module 215, 215-a, and transmitter module 220, 220-a,respectively, as illustrated in FIGS. 2A-2B. In some embodiments,control panel 135-b may additionally comprise a display.

As previously discussed with respect to FIGS. 2A-2B, receiver module 505may receive user proximity, occupancy, or approach data from one or moresensors integrated with the control panel 135-b, or alternatively fromone or more sensor units located adjacent to or positioned remotely fromthe control panel 135-b. Receiver module 505 may communicate the userproximity data to projection management module 510, which may calculatea proximity of the user to the control panel 135-b based on the receiveddata, and may further calculate a projection delay based on theproximity data, such that a projection is only initiated when the useris immediately in front of our passing by the control panel 135-b.Projection management module 510 may then project a message orinteractive keypad at the control panel 135-b onto a wall, ceiling,floor, door, or other appropriate opaque surface adjacent to or acrossfrom the control panel 135-b. A user may simply read the projectedmessage, or may interact with the projected keypad. Projectionmanagement module 510 may therefore be operable to process user input atthe projected virtual keypad, in the form of user finger movements orgestures. Projection management module 510 may communicate the userinput data to transmitter module 515. In some embodiments, transmittermodule 515 may communicate action instructions to a display on thecontrol panel 135-b, which may be an LED or other visual display screen,to display information corresponding to the user's input. For example, auser inputting a disarming code at the virtual keypad may be shown a“SYSTEM DISARMED” message on the display. Alternatively or in addition,transmitter module 515 may communicate action instructions to a remotecomputing device or home automation system to execute actioninstructions based on the user input, for example to arm or disarm asecurity system, change a thermostat setting, or the like. In stillother embodiments, where control panel 135-b is a door lockingmechanism, transmitter module 515 may communicate a “door unlock” actioninstruction to the locking mechanism with which the control panel 135-bis integrated or collocated.

The components of the control panel 135-a may, individually orcollectively, be implemented using one or more application-specificintegrated circuits (ASICs) adapted to perform some or all of theapplicable functions in hardware. Alternatively, the functions may beperformed by one or more other processing units (or cores), on one ormore integrated circuits. In other examples, other types of integratedcircuits may be used (e.g., Structured/Platform ASICs, FieldProgrammable Gate Arrays (FPGAs), and other Semi-Custom ICs), which maybe programmed in any manner known in the art. The functions of eachmodule may also be implemented—in whole or in part—with instructionsembodied in memory formatted to be executed by one or more generaland/or application-specific processors.

FIG. 6 is a flow chart illustrating an example of a method 600 forprojecting an external display at a control panel as part of a homeautomation system, in accordance with various aspects of the presentdisclosure. For clarity, the method 600 is described below withreference to aspects of one or more of the sensor units 110 and controlpanel 135 described with reference to FIGS. 1-5, and/or aspects of oneor more of the apparatus 205, 205-a described with reference to FIGS.2A-2B. In some examples, a control panel and/or sensor unit may executeone or more sets of codes to control the functional elements describedbelow. Additionally or alternatively, the control panel and/or sensorunit may perform one or more of the functions described below usingspecial-purpose hardware.

At block 605, the method 600 may include detecting the proximity of auser at a home automation device. The home automation device maycomprise a control panel, or alternatively may comprise a door lockingmechanism. As previously discussed, user proximity may be detected byone or more sensor units, where the sensor units may be integrated withor separate from the home automation device. Where the one or moresensor units are positioned separately from the home automation device,the user proximity data may be communicated, for example via wired orwireless communication links, to the home automation device.

User proximity at the home automation device may be detected using anyacceptable means, including detecting motion, vibration, heat orheartbeat, or the like. In addition or alternatively, user proximity maybe detected by sensing Bluetooth, RFID, Wi-Fi, or other wireless signalsemitted from a device, such as a fob or mobile device, in the user'spossession.

At block 610, the method 600 may include projecting an external displayof home automation system information from the home automation deviceonto a surface, wherein the external display is projected based, atleast in part, on the detected proximity of the user to the homeautomation device. The external display may comprise a messagecontaining information relating to the home automation system, or mayalternatively comprise an interactive keypad. By projecting an externaldisplay based, at least in part, on detected user proximity, energyresources may be conserved. In particular, projections may be initiatedonly when a user is present to view the projections. In addition, byprojecting an external display based, at least in part, on detected userproximity, a user may view projected messages without the need tointeract directly with the device, for example to turn the device on oroff.

The operations at blocks 605 and 610 may be performed using the receivermodule 210, 210-a, 505, the projection management module 215, 215-a,510, and/or the transmitter module 220, 220-a, 515, described withreference to FIGS. 2A-2B and 5.

Thus, the method 600 may provide for external projection methodsrelating to home automation/security systems. It should be noted thatthe method 600 is just one implementation and that the operations of themethod 600 may be rearranged or otherwise modified such that otherimplementations are possible.

FIG. 7 is a flowchart illustrating an example of a method 700 fordetecting user proximity at a sensor unit, in accordance with variousaspects of the present disclosure. For clarity, the method 700 isdescribed below with reference to aspects of one or more of the sensorunits 110 and control panel 135 described with reference to FIGS. 1-5,and/or aspects of one or more of the apparatus 205, 205-a described withreference to FIGS. 2A-2B. In some examples, a control panel and/orsensor unit may execute one or more sets of codes to control thefunctional elements described below. Additionally or alternatively, thecontrol panel and/or sensor unit may perform one or more of thefunctions described below using special-purpose hardware.

At block 705, method 700 may include detecting proximity of a user at asensor. As previously discussed, one or more sensors may be integratedwith or collocated at a home automation device, where the homeautomation device may comprise a control panel or door lockingmechanism. In other embodiments, one or more sensor units may bepositioned separately from the home automation device, and any userproximity data detected at the one or more sensor units may becommunicated, for example via wired or wireless communication links, tothe home automation device.

At block 710, method 700 may include identifying the user as an approveduser. This may be achieved by any appropriate means. In some examples,the one or more sensor units may detect user identity by biosignaturedetecting technology. In other embodiments, the one or more sensor unitsmay detect user identity by detecting signals transmitted from a mobiledevice in the approaching user's possession. For example, the mobiledevice may comprise a smartphone or fob emitting any of a Bluetooth,RFID, Wi-Fi, or other acceptable wireless signal. The one or more sensorunits may identify the user as an approved user based, at least in part,on an authenticated signal received from the mobile device.

At block 715, method 700 may comprise communicating user proximity datato a home automation device. Where the sensor unit is collocated orintegrated with the home automation device, this communication may occurbetween modules comprising the home automation device, as previouslydiscussed with regard to FIGS. 2A-2B. Alternatively, where the one ormore sensor units are positioned remotely from the home automationdevice, the proximity data of the approved user may be communicated tothe home automation device, for example via a wired or wirelesscommunication link. Where a user is not identified as an approved userat block 710, no external projection may be initiated at the homeautomation device.

In some embodiments, the approaching user's identity need not beauthenticated, and method 700 may proceed directly from block 705 toblock 715, such that user proximity data is detected and communicated tothe home automation device.

FIG. 8 is a flowchart illustrating an example of a method 800 forreceiving user input at a projected display, in accordance with variousaspects of the present disclosure. For clarity, the method 800 isdescribed below with reference to aspects of one or more of the sensorunits 110 and control panel 135 described with reference to FIGS. 1-5,and/or aspects of one or more of the apparatus 205, 205-a described withreference to FIGS. 2A-2B. In some examples, a control panel and/orsensor unit may execute one or more sets of codes to control thefunctional elements described below. Additionally or alternatively, thecontrol panel and/or sensor unit may perform one or more of thefunctions described below using special-purpose hardware.

At block 805, method 800 may include receiving user proximity data andsensor location data at a home automation device. As previouslydiscussed, user proximity data may be detected by one or more sensorunits. In some embodiments, the one or more sensor units may becollocated or integrated with the home automation device. In otherembodiments, the one or more sensor units may be positioned remotelyfrom the home automation device. Where the one or more sensor units arepositioned remotely from the home automation device, the one or moresensor units may transmit, along with user proximity data, sensorlocation data to the home automation system. In other embodiments,sensor location information may be received at the home automationdevice from a local or remote computing device. User proximity data maybe detected by any known means, including by detecting motion,vibration, heat or heartbeat, or biosignals, or a combination thereof.Alternatively or in addition, user proximity may be detected byreceiving signals transmitted from a mobile device, such as a smartphoneor fob.

At block 810, method 800 may include processing a projection delay atthe home automation device based, at least in part, on the userproximity data and sensor location data. As previously described withrespect to FIG. 2B, a proximity detector module and projection delaymodule may be used to calculate a projection delay time period based onuser proximity to a sensor unit, and further based on a distance of thesensor unit from the control panel which will initiate the projection.For example, a sensor unit positioned at a front door may detect userapproach to the front door. The sensor unit may communicate the userapproach data to a control panel located in a living room. A proximitydetector module and projection delay module comprising the control panelmay then process a projection delay based, at least in part, on the userproximity data and sensor location data, such that the projection isinitiated only after the user has had sufficient time to travel from thesensor unit at the front door to the control panel in the living room.In other embodiments, user proximity may be detected directly at acontrol panel and, depending upon the proximity of the user to thecontrol panel, no projection delay may be necessary, and projection maybe initiated immediately upon user proximity detection. In this way,messages and/or interactive keypads may be projected at home automationdevices only when the user is positioned close enough to the homeautomation device to see and/or interact with the projection. In someembodiments, this proximity may allow for user approach to andinteraction with the home automation device, whereas in otherembodiments, this proximity may allow for a user to view a projectedmessage as he passes by the home automation device, without stopping ator interacting with the home automation device.

At block 815, method 800 may include displaying an external projectionat the home automation device as any of an interactive keypad, a messagedisplay, or a combination thereof. At block 820, method 800 may includereceiving user input at the home automation device based, at least inpart, on user input at the projected display. As previously discussedwith respect to FIG. 2B, an input processor module at the homeautomation device may receive and process user input at the projecteddisplay in the form of user “typing” at the projected virtual keypad, orin the form of user gestures. User input received and processed by theinput processor module may then be translated into action instructions,for example instructions to lock or unlock a door, arm or disarm asecurity system, turn lights on or off, or the like. In someembodiments, the action instructions may be executed locally at the homeautomation system, or in other embodiments may be communicated to aremote computing device or remote home automation system for execution.

In some examples, aspects from two or more of the methods 600, 700, 800may be combined and/or separated. It should be noted that the methods600, 700, 800 are just example implementations, and that the operationsof the methods 600-800 may be rearranged or otherwise modified such thatother implementations are possible.

The detailed description set forth above in connection with the appendeddrawings describes examples and does not represent the only instancesthat may be implemented or that are within the scope of the claims. Theterms “example” and “exemplary,” when used in this description, mean“serving as an example, instance, or illustration,” and not “preferred”or “advantageous over other examples.” The detailed description includesspecific details for the purpose of providing an understanding of thedescribed techniques. These techniques, however, may be practicedwithout these specific details. In some instances, known structures andapparatuses are shown in block diagram form in order to avoid obscuringthe concepts of the described examples.

Information and signals may be represented using any of a variety ofdifferent technologies and techniques. For example, data, instructions,commands, information, signals, bits, symbols, and chips that may bereferenced throughout the above description may be represented byvoltages, currents, electromagnetic waves, magnetic fields or particles,optical fields or particles, or any combination thereof.

The various illustrative blocks and components described in connectionwith this disclosure may be implemented or performed with ageneral-purpose processor, a digital signal processor (DSP), an ASIC, anFPGA or other programmable logic device, discrete gate or transistorlogic, discrete hardware components, or any combination thereof designedto perform the functions described herein. A general-purpose processormay be a microprocessor, but in the alternative, the processor may beany conventional processor, controller, microcontroller, and/or statemachine. A processor may also be implemented as a combination ofcomputing devices, e.g., a combination of a DSP and a microprocessor,multiple microprocessors, one or more microprocessors in conjunctionwith a DSP core, and/or any other such configuration.

The functions described herein may be implemented in hardware, softwareexecuted by a processor, firmware, or any combination thereof. Ifimplemented in software executed by a processor, the functions may bestored on or transmitted over as one or more instructions or code on acomputer-readable medium. Other examples and implementations are withinthe scope and spirit of the disclosure and appended claims. For example,due to the nature of software, functions described above can beimplemented using software executed by a processor, hardware, firmware,hardwiring, or combinations of any of these. Features implementingfunctions may also be physically located at various positions, includingbeing distributed such that portions of functions are implemented atdifferent physical locations.

As used herein, including in the claims, the term “and/or,” when used ina list of two or more items, means that any one of the listed items canbe employed by itself, or any combination of two or more of the listeditems can be employed. For example, if a composition is described ascontaining components A, B, and/or C, the composition can contain Aalone; B alone; C alone; A and B in combination; A and C in combination;B and C in combination; or A, B, and C in combination. Also, as usedherein, including in the claims, “or” as used in a list of items (forexample, a list of items prefaced by a phrase such as “at least one of”or “one or more of”) indicates a disjunctive list such that, forexample, a list of “at least one of A, B, or C” means A or B or C or ABor AC or BC or ABC (i.e., A and B and C).

In addition, any disclosure of components contained within othercomponents or separate from other components should be consideredexemplary because multiple other architectures may potentially beimplemented to achieve the same functionality, including incorporatingall, most, and/or some elements as part of one or more unitarystructures and/or separate structures.

Computer-readable media includes both computer storage media andcommunication media including any medium that facilitates transfer of acomputer program from one place to another. A storage medium may be anyavailable medium that can be accessed by a general purpose or specialpurpose computer. By way of example, and not limitation,computer-readable media can comprise RAM, ROM, EEPROM, flash memory,CD-ROM, DVD, or other optical disk storage, magnetic disk storage orother magnetic storage devices, or any other medium that can be used tocarry or store desired program code means in the form of instructions ordata structures and that can be accessed by a general-purpose orspecial-purpose computer, or a general-purpose or special-purposeprocessor. Also, any connection is properly termed a computer-readablemedium. For example, if the software is transmitted from a website,server, or other remote source using a coaxial cable, fiber optic cable,twisted pair, digital subscriber line (DSL), or wireless technologiessuch as infrared, radio, and microwave, then the coaxial cable, fiberoptic cable, twisted pair, DSL, or wireless technologies such asinfrared, radio, and microwave are included in the definition of medium.Disk and disc, as used herein, include compact disc (CD), laser disc,optical disc, digital versatile disc (DVD), floppy disk and Blu-ray discwhere disks usually reproduce data magnetically, while discs reproducedata optically with lasers. Combinations of the above are also includedwithin the scope of computer-readable media.

The previous description of the disclosure is provided to enable aperson skilled in the art to make or use the disclosure. Variousmodifications to the disclosure will be readily apparent to thoseskilled in the art, and the generic principles defined herein may beapplied to other variations without departing from the scope of thedisclosure. Thus, the disclosure is not to be limited to the examplesand designs described herein but is to be accorded the broadest scopeconsistent with the principles and novel features disclosed.

This disclosure may specifically apply to security system applications.This disclosure may specifically apply to automation systemapplications. In some embodiments, the concepts, the technicaldescriptions, the features, the methods, the ideas, and/or thedescriptions may specifically apply to security and/or automation systemapplications. Distinct advantages of such systems for these specificapplications are apparent from this disclosure.

The process parameters, actions, and steps described and/or illustratedin this disclosure are given by way of example only and can be varied asdesired. For example, while the steps illustrated and/or described maybe shown or discussed in a particular order, these steps do notnecessarily need to be performed in the order illustrated or discussed.The various exemplary methods described and/or illustrated here may alsoomit one or more of the steps described or illustrated here or includeadditional steps in addition to those disclosed.

Furthermore, while various embodiments have been described and/orillustrated here in the context of fully functional computing systems,one or more of these exemplary embodiments may be distributed as aprogram product in a variety of forms, regardless of the particular typeof computer-readable media used to actually carry out the distribution.The embodiments disclosed herein may also be implemented using softwaremodules that perform certain tasks. These software modules may includescript, batch, or other executable files that may be stored on acomputer-readable storage medium or in a computing system. In someembodiments these software modules may permit and/or instruct acomputing system to perform one or more of the exemplary embodimentsdisclosed here.

This description, for purposes of explanation, has been described withreference to specific embodiments. The illustrative discussions above,however, are not intended to be exhaustive or limit the present systemsand methods to the precise forms discussed. Many modifications andvariations are possible in view of the above teachings. The embodimentswere chosen and described in order to explain the principles of thepresent systems and methods and their practical applications, to enableothers skilled in the art to utilize the present systems, apparatus, andmethods and various embodiments with various modifications as may besuited to the particular use contemplated.

What is claimed is:
 1. A method for security and/or automation systems, comprising: detecting an occupant of a premises in an initial area of the premises; detecting the occupant satisfying a proximity threshold in relation to an automation device in a room of the premises; implementing a time delay before initiating a projection of automation system information based at least in part on a distance between the initial area and the room; and projecting the automation system information from the automation device onto a surface of the room upon detecting the occupant satisfying the proximity threshold.
 2. The method of claim 1, further comprising: receiving input at the automation device based, at least in part, on input from the occupant in relation to the projected automation system information.
 3. The method of claim 2, further comprising: deactivating the projecting of the automation system information after an exit time delay, after detecting the occupant exiting the room, after the occupant no longer satisfies the proximity threshold, or any combination thereof, wherein the input received at the automation device is any one of a user passcode, audible input, a gesture, or a combination thereof.
 4. The method of claim 1, wherein satisfying the proximity threshold at the automation device is detected by any one of a motion detector, an infrared or near-infrared sensor, a video camera, a facial recognition sensor, an RFID sensor, a vibration detector, or detection of a mobile device coupled to the automation device by Bluetooth or wireless connectivity, or a combination thereof.
 5. The method of claim 1, wherein the automation device is any one of a smart panel, a door locking mechanism, or a combination thereof.
 6. The method of claim 1, wherein the automation device is mounted on any one of a wall, floor, ceiling, door, or a combination thereof.
 7. The method of claim 1, wherein the surface onto which the external display is projected is any one of a wall, floor, ceiling, door, or a combination thereof.
 8. The method of claim 1, wherein the projected information is any one of an interactive keypad, a message display, or a combination thereof.
 9. The method of claim 1, further comprising: identifying the occupant at the automation device based, at least in part, on any one of facial recognition, RFID coupling, smartphone coupling, or a combination thereof.
 10. The method of claim 9, wherein the information is projected only upon identification of an authorized occupant.
 11. The method of claim 9, wherein the information projected is specific to the identified occupant.
 12. An apparatus for security and/or automation systems, comprising: a processor; memory in electronic communication with the processor; and instructions stored in the memory, the instructions being executable by the processor to: detect an occupant of a premises in an initial area of the premises; detect the occupant satisfying a proximity threshold in relation to an automation device in a room of the premises; implement a time delay before initiating a projection of automation system information based at least in part on a distance between the initial area and the room; and project the automation system information from the automation device onto a surface of the room upon detecting the occupant satisfying the proximity threshold.
 13. The apparatus of claim 12, further comprising: a receiver to receive input at the automation device based, at least in part, on input from the occupant in relation to the projected automation system information.
 14. The apparatus of claim 12, further comprising: an occupant identity detector.
 15. The apparatus of claim 14, wherein the occupant identity detector is any one of a facial recognition sensor, an RFID sensor, a smartphone sensor, or a combination thereof.
 16. The apparatus of claim 14, wherein the information is projected only upon identification of an approved occupant.
 17. The apparatus of claim 14, wherein the information projected is specific to the identified occupant.
 18. The apparatus of claim 12, wherein the automation device is any one of a control panel, a door locking mechanism, or a combination thereof.
 19. The apparatus of claim 12, wherein the projected information is any one of an interactive keypad, a message display, or a combination thereof.
 20. A non-transitory computer-readable medium storing computer-executable code for security and/or automation systems, the code executable by a processor to: detect an occupant of a premises in an initial area of the premises; detect the occupant satisfying a proximity threshold in relation to an automation device in a room of the premises; implement a time delay before initiating a projection of automation system information based at least in part on a distance between the initial area and the room; and project the automation system information from the automation device onto a surface of the room upon detecting the occupant satisfying the proximity threshold. 